Skip to content

[Model] Add MiniMax-H3 diffusion GGUF support - #119

Draft
lishunyang12 wants to merge 4 commits into
vllm-project:mainfrom
lishunyang12:feat/minimax-h3-diffusion-gguf
Draft

[Model] Add MiniMax-H3 diffusion GGUF support#119
lishunyang12 wants to merge 4 commits into
vllm-project:mainfrom
lishunyang12:feat/minimax-h3-diffusion-gguf

Conversation

@lishunyang12

@lishunyang12 lishunyang12 commented Aug 23, 2026

Copy link
Copy Markdown

Summary

  • add a MiniMax-H3 diffusion adapter for GGUF DiT weights
  • preserve non-DiT checkpoint names so vLLM-Omni model loaders retain ownership of model-specific mapping and fusion
  • keep quantized fused QKV tensors intact while restoring dense QKV tensors to the checkpoint layout expected by MiniMax-H3
  • enforce the generic one-gguf_model-to-one-weight-source invariant
  • reject incompatible H3 schemas before model loading with an actionable error
  • expose tested coverage at the family level as Video generation | MiniMax-H3 | Q4_K_M

Supported scope

  • one task-specific MiniMax-H3 DiT per process
  • non-pruned GGUF schema with complete time_embedder weights
  • text encoder and VAEs remain on base Hugging Face weights
  • combined FL2VA + Ref2VA loading is not supported by one gguf_model
  • end-to-end validation in this PR covers FL2VA; it does not claim Ref2VA end-to-end validation

Validation

  • python -m pytest -q tests/diffusion -m "not slow": 47 passed, 2 deselected
  • focused MiniMax-H3 adapter and diffusion-loader tests: 27 passed
  • Ruff and pre-commit checks passed
  • full leejet/MiniMax-H3-GGUF/minimax_h3_fl2va-Q4_K_M.gguf strict load and generation succeeded on one NVIDIA B300
  • generated video shape: (107, 256, 256, 3)
  • generated audio shape: (1, 2, 142400)
  • observed peak GPU memory: 81644 MiB

This is one functional end-to-end validation run, not a latency or memory benchmark.

Validation environment

Component Version / configuration
vLLM 0.27.0
vLLM-Omni c06c286bc1bf4ffd13952f658bc71279ab715437
Plugin baseline fb973ad784f38b98b054e136bec3414b7cd8494d
PyTorch 2.13.0+cu130
Transformers 5.14.1
gguf 0.19.0
GPU NVIDIA B300, one GPU

Documentation

Signed-off-by: david6666666 <530634352@qq.com>
Signed-off-by: david6666666 <530634352@qq.com>
@lishunyang12
lishunyang12 force-pushed the feat/minimax-h3-diffusion-gguf branch from 331a747 to 11d062f Compare August 23, 2026 02:33
Signed-off-by: david6666666 <530634352@qq.com>
@lishunyang12
lishunyang12 marked this pull request as draft August 23, 2026 04:19
Signed-off-by: david6666666 <530634352@qq.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants